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(57) Abstract: The invention relates to a method for determining the position of at least one teat of an udder of an animal for 
rf^s milking, comprising of: illuminating points on the udder with at least one directed light source in a predetermined pattern; detecting 
points illuminated with the light source in the pattern with recording means; determining position data of illuminated points from 
a detection of the recording means on the basis of triangulation; forming a three-dimensiona] representation of the udder from the 
position data and the pattern; recognizing the teat in the three-dimensional representation; and determining the location of the teat 
^ on the basis of the recognition and with the position data 
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METHOD AND APPARATUS FOR DETECTION OF TEATS 

The present invention relates to a method and 
device for determining the position of at least one teat 
of an udder of an animal for milking. Such methods and 
devices are generally known, but often have 
5 shortcomings . 

From the Netherlands publication 9500006 a 
technique is for instance known, wherein an image is 
formed, teats are identified in the image, the position 
of teats is compared to a previous localization and an 

10 obtained image is stored in a memory for comparison at a 
subsequent milking. 

This technique is time-consuming because a camera 
for forming the image will with certainty rarely be 
positioned exactly the same relative to the udder of the 

15 animal for milking as in a previously obtained image. 
For this reason alone the comparison with a previously 
formed image is useless and adjusted images will have to 
be stored in the memory each time, which does not have a 
good impact on the operating system in particular. 

20 Further known from for instance EP-A-0 . 777 . 961 is a 

technique, wherein two cameras are applied which are 
each fixedly mounted on the milking parlour in which the 
device is disposed. The orientation of the cameras is 
variable, so that they can be directed at the relevant 

25 udder with the teats thereon. The cameras are situated 
in a housing for protection against damage by the 
animals for milking. This publication also discloses, as 
an option, the use of a combined transmitter-receiver, 
which emits a laser beam with the transmitter and 

30 records the reflection thereof with the receiver. 
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It has been found in practice that none of these 
prior art systems suffices. 

The present invention has for its object to provide 
a method and a device which can be utilized in practice 
5 and with which the position of the teats can be 

determined sufficiently quickly to enable immediate 
connection of teat cups thereto. For this purpose the 
method comprises the steps according to the independent 
method claims and the device according to the invention 
10 has the features according to the independent device 
claims . 

In a preferred embodiment a method according to the 
present invention has the further feature that the light 
source is driven pulsatingly. This prevents daylight or 

15 sunlight having a disrupting influence on the detection 
of the illuminated points of the udder or the udder 
itself. It is herein possible to switch on the light 
source when the recording means are activated. A 
synchronization thus takes place. It is then possible to 

20 use a considerably higher light intensity when light is 
projected onto the udder. The illuminated points hereby 
become more readily detectable, since the illuminated 
points are distinguished better from non-illuminated 
points. It is not a solution here to simply increase the 

25 intensity of a non-pulsating light source. This could 
cause eye hazard to for instance a user. Despite a 
higher peak capacity, a pulsating light source can be 
driven such that the light pulses are hardly visible to 
the human eye, or not at all, so that this cannot cause 

30 any hazard. 

In yet another preferred embodiment, at least two 
detections are made with the light source in and out of 
operation, and the difference between the detections 
with the light source in and out of operation is 

35 calculated. In the detection with the light source in 
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operation , detection elements are present which are not 
only the result of the projected light per se, but 
result from ambient light. By removing these detection 
elements, wherein the difference is calculated between 
5 the two detections, the resolution, or contrast, of the 
detection of the projected light can be increased. 

In a preferred embodiment a teat cup is connected 
to the teat by a robot arm at the determined or 
established location of the teat. A robot arm can be 
10 actuated sufficiently rapidly to connect the teat cup 
immediately after determining of the position of the 
teat. 

The light source and the recording means can 
further be disposed stationary relative to each other. 
15 The number of calculations in the triangulation is 
hereby limited, since varying positions of the light 
source and the recording means relative to each other do 
not have here to be taken into account . The recording 
means and the light source can for instance be arranged 

4 

20 together on the robot arm used to arrange teat cups on 
the teats. The invention is however not limited hereto. 
Additionally or alternatively, the light source and the 
recording means can also be disposed separately and 
displaceably relative to each other. All that is 

25 important for triangulation purposes is that the mutual 
positioning is known at a certain moment, when a 
detection is recorded. In the case of a separate and 
displaceable setup of light source and recording means, 
one of the light source and the recording means can 

30 advantageously be arranged on the robot arm. This is 

then preferably the light source, so that a movement of 
the robot arm during obtaining of the detections can 
correspond with at least one part of the pattern to be 
followed. 
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The pattern can be followed in different ways. One 
possibility is that the light source is displaced in a 
direction corresponding with the pattern, although the 
light source can also be held stationary per se, wherein 
5 the orientation of the light source is varied in 
accordance with the pattern. It is also possible to 
displace the light source and to vary the orientation 
thereof, wherein the pattern to be followed is zigzag- 
shaped. The light source can herein be displaced in a 

10 first direction and the orientation can be varied in a 
second direction. This is a favourable manner of 
obtaining in a short time the required image of the 
udder of an animal for milking. 

Assuming that the udder is approached from a side 

15 of the animal for milking, it may be favourable to have 
the second direction correspond with the longitudinal 
direction of the animal for milking. The first direction 
thus corresponds with the direction in which the animal 
for milking is approached, so that the approaching 

20 movement can be used as the displacement of the light 

source in the first direction required for imaging. The 
displacement of the light source is thus combined in 
favourable manner with the approaching of the udder. 

The method further preferably comprises of defining 

25 a distinction between a part of the udder located close 
to the robot arm and a part of the udder located further 
from the robot arm, which udder then has at least two 
teats, at least one of which belongs to each of the 
parts. A number of teat cups are connected one by one to 

30 the teats of the udder, which must begin at the teats in 
the part situated further away from the robot arm in 
order to prevent arranged teat cups coming to lie in the 
way of those teats to which a teat cup has yet to be 
connected. This is particularly the case in an 

35 embodiment wherein the robot arm and teat cups for 
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connecting are all positioned on one side or behind the 
animal for milking. 

The present invention will be further elucidated 
herein below on the basis of the description of the 
5 annexed drawings, wherein the same and similar parts and 
components are designated with the same reference 
numerals, and wherein: 

fig. 1 shows schematically a possible embodiment of 
a device according to the present invention, wherein the 
10 method according to the invention is implemented; 

fig. 2 shows a detail of the device of fig. 1 in 
operation; 

fig. 3 shows a detail of the device according to 
fig. 1 and 2; 

15 fig. 4 shows a schematic view of the manner in 

which the device according to the present invention 
displays an udder of an animal for milking in accordance 
with the method; 

fig. 5 shows schematically a further step of the 
20 embodiment; and 

fig. 6 shows a realization of the embodiment shown 
in fig. 5. 

Fig. 1 shows a device 1 according to the present 
invention. This comprises a milking robot 2 which in the 
25 . embodiment shown here is embodied as an industrial 
robot . 

Milking robot 2 is used to engage and arrange teat 
cups 3 on teats 4 of an udder 5 of a cow for milking 6. 
Teat cups 3 are hung in a holder 7 prior to use 
30 thereof where the teat cups 3 are arranged on teats 4 of 
udder 5. Milking robot 2 is adapted to remove teat cups 
3 from holder 7 and arrange them. As shown more clearly 
in fig. 2 and 3, a gripper 8 with which teat cups 3 can 
be gripped is arranged for this purpose on the outer end 
35 of milking robot 2. Once gripped, the teat cups 3 are 
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carried by milking robot 2 into the vicinity of teats 4 
and teat cups 3 are each connected one by one to a teat 
4. 

It is noted that, with a robot arm which connects 
5 the teat cups one by one, it is also possible to arrange 
teat cups selectively. If a cow for milking for instance 
kicks off one of the teat cups, it must be reconnected, 
which is possible in the shown device according to the 
invention using the present method. 

10 For this purpose the position and preferably also 

the orientation of teats 4 have to be determined, in 
order to actuate milking robot 2 on the basis of this 
determination when arranging the teat cups 3 on teats 4. 
A camera 9 and a light source 10 are arranged for 

15 this purpose on the robot arms, as is for instance also 
shown in fig. 3. 

Camera 9 and light source 10 are arranged on the 
milking robot 2 designed as an industrial robot and are 
situated in the vicinity of gripper 8. Light source 10 

20 is for instance a laser generator, with which visible 
light is emitted in upward direction to udder 5 in the 
direction of arrow A in fig. 3 so as to form an image of 
udder 5. Light source 10 is herein situated on a part 11 
of the milking robot rotatable in the direction of arrow 

25 B, while camera 9 is mounted on a part 12 which is fixed 
relative to part 11. The mutual distance between light 
source 10 and camera 9 therefore remains the same at all 
times. The assembly of rotatable part 11 and >A fixed" 
part 12 is displaced in the direction of arrow C during 

30 imaging, while rotatable part 11 follows a reciprocal 
movement in the direction of arrow B . 

As shown in fig. 4, the udder of the cow 6 for 
milking is approached from the direction of arrow D by 
the robot arm with a teat cup gripped thereby. A 

35 scanning grid as shown in fig. 4 is followed by 
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displacement in the direction of arrow C in fig. 3 and 
rotation of the rotatable part 11 in the direction of 
arrow B in fig. 3. The pattern thus followed comprises 
lines 13 on which light from light source 10 is 
5 incident . 

Light source 10 is driven pulsatingly. Light source 
10 is under a control such that a light pulse is 
generated only when camera 9 is ready for a new 
recording, for instance when the shutter of camera 9 is 

10 open. Recordings without light pulse can also be made 
for comparison with images recorded with light pulses, 
as will be further described herein below. 

Since the base of a triangle formed by camera 9, 
light source 10 and a point on which light from light 

15 source 10 is incident, is known, the distance to the 
point on which light from the light source is incident 
can be determined using triangulation, in any case 
relative to adjacent points along lines 13. 

Making use of this detection of the point of 

20 incidence, a triangulation calculation is therefore 
performed by a control (not shown) of device 1. Here 
from a so-called contour map can be developed of the 
udder, in which the teats 4 are then clearly 
recognizable. The contour map is thus a three- 

25 dimensional representation of the udder, on the basis of 
which the teats can be recognized. The position of the 
teats can thus be determined as a result of recognition 
of teats 4. 

As noted above, light source 10 is driven 

30 pulsatingly. It is hereby possible to increase the peak 
capacity of the light pulses without the danger of 
damage to eyes, in order to increase the resolution of 
illuminated points in the detection. The difference can 
herein be taken between a detection with the light 

35 source in operation and a detection with the light 
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source out of operation. Effecting hereof achieves that 
the influence of points not illuminated with the light 
source affect the recognition of the points in the 
result of the differential calculation. The influence of 
5 external light sources, and also of ambient light such 
as daylight, are thus minimized as much as possible. 
Particularly in combination with the pulsating driving 
of the light source, to which the invention is of course 
not limited, it is possible to record an image with the 

10 camera when the light source 10 is out of operation and 
subsequently to record an image when light source 10 is 
in operation, so as to then be able to calculate the 
difference there between. The contrast, or resolution, 
is hereby increased. Due to the short time spans between 

15 successive detections subjected to the differential 

calculation, changes in the ambient light will have very 
little or no influence on the recognition of the point 
of the udder illuminated by the light source. 

Using gripper 8 of milking robot 2, a teat cup 3 

# 

20 can then be arranged on a recognized teat, the position 
of which is thus determined. It is noted that, in 
addition to determining the position of teats 4, an 
axial line 14 running in the longitudinal direction of 
cow 6 is also defined. On the basis of this axial line 

25 14 it is decided on which teats 4 a teat cup 3 first has 
to be connected. This is to prevent it not being 
possible, from the direction of approach indicated by 
arrow D from which the milking robot 2 approaches udder 
5, to readily approach the rearmost teats 4 (to the left 

30 of axial line 14 in fig. 4) for arranging of a teat cup 
3 thereon, when teat cups have already been arranged on 
the other teats 4 (to the right of axial line 14 in fig. 
4) . The teats 4 at the rear in respect of the direction 
of approach of arrow D (to the left of axial line 14) 

35 are thus connected first to the milking system. An 
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appropriate sequence is also employed here in which the 
teat cups 3 are removed from holder 7. The hoses 15 
connected to teat cups 3 are thus prevented from 
becoming entangled. 
5 Fig. 5 shows a possible embodiment which is based 

on three images. For image processing two non- 
illuminated images are used together with one 
illuminated image. The non-illuminated images are 
designated with reference numerals 16, while the 
10 illuminated image is designated with reference numeral 
17. These three images are then combined/ resulting in 
image 18. 

The difference between illuminated image 17 and 
combined image 18 is then taken, which results in the 

15 final image 19, on the basis of which the above stated 
contour map can be obtained. 

In the original illuminated and non-illuminated 
images 16 and 17 movements of the animal for milking are 
indicated with arrows. It is clearly shown that the 

20 sensitivity of the imaging during movements of an animal 
for milking, for instance a cow, is reduced by using 
three images for this purpose. This is clearly shown 
from the resulting image 19. Reducing this sensitivity 
to movements of an animal is makes it possible to obtain 

25 a very reliable contour map. 

During arranging of teat cups, the robot arm can 
then make use of the position of the teat cup relative 
to the udder represented by the contour map in order to 
orient the teat cup relative to the teat on which the 

30 teat cup must be arranged. 

Fig. 6 shows the manner in which the method shown 
schematically in fig. 5 can be applied in a series of 
successively illuminated and non-illuminated images 17 
and 16. A group of three images 16, 17 at a time is 
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selected, wherein a illuminated image is recorded at a 
moment between obtaining two non-illuminated images. 

It is noted that in such a method a relatively 
large number of calculations, is required to calculate 
5 the contour maps and so on; Such a large number of 

calculations requires a proportional amount of time. In 
order to reduce this amount of time, the option is 
provided according to the present invention to perform 
calculations only for those points which are not dark in 

10 the image obtained with an activated light source. The 
reverse is also possible. The calculations are then 
performed here only for the dark points in the image 
which is recorded at a moment that the light source. has 
been in or out of operation. A considerable amount of 

15 information is thus used to obtain or calculate the 

contour map, in order to provide a reliable contour map, 
while the number of calculations required for the 
purpose is considerably reduced. 

Although a configuration is shown in fig. 'l and 2 

20 wherein the robot arm and the teat cups for arranging 
therewith on the teats are disposed opposite each other 
relative to cow 6, it is recommended to dispose the 
robot arm and the teat cups for connecting on the same 
side of the cow for milking, this in respect of the 

25 connecting sequence as just described above. In the 

configuration shown in fig. 1 and 2 the advantage of a 
choice of connecting sequence is not achieved because a 
teat cup, once connected, will be in the way of the 
robot arm each time it goes to collect a new teat cup 

30 for connecting, irrespective of the connecting sequence. 
The configurations shown in fig. 1 and 2 are 
nevertheless still a possible embodiment of the present 
invention. 

It will be apparent that in fig. 4 a pattern is 
35 followed with the light coming from light source 10. In 
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fig. 4 this is a line pattern running parallel to the 
axial line 14 to be deduced from the detections and 
position determinations. Other patterns are of course 
also possible for the purpose of, so to speak, scanning 
5 or mapping the udder 5. Lines 13 can thus run obliquely 
relative to axial line 14 or transversely thereof. This 
shows clearly that the present invention, as defined in 
the appended claims, is not limited to the specific 
embodiments as shown in the figures and described in the 

10 accompanying description. 

A light source other than a laser can also be used, 
or a plurality of light sources can be employed and a 
light source can be switched on continuously without 
pulsation. Discrete points will preferably further be 

15 used along the lines to perform the triangulation 

calculation therefor. The lines in fig. 4 only serve to 
illustrate a possible pattern followed by the light 
coming from the light source. When the light from the 
light source has reached a desired point along one of 

20 lines 13, a detection with the recording means in the 
form of camera 9 is subjected to the triangulation 
calculation. The differences in the results of the 
triangulation calculation for adjacent separate discrete 
points, both along one of lines 13 and between lines 13, 

25 supply the information required for creating the contour 
map, which forms a three-dimensional representation of 
the udder. Teats can be recognized here from, the 
position of which can then be determined. 

It is further possible for a milking robot to be 

30 employed to arrange teat cups from the rear side of the 
animal for milking, i.e. along the line 14 shown in fig. 
4. It will be apparent that the axial line for the 
purpose of determining the connecting sequence will then 
be chosen transversely relative to the axial line shown 
35 in fig. 4. Further embodiments comprise for instance a 
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gripper which can arrange more than one teat cup at a 
time. Although a cow with four teats is explicitly 
described above as animal for milking, the invention is 
also applicable in the milking of goats (two teats) and 
5 sheep or cows having only three teats, for which purpose 
it is favourable to connect the teat cups one by one. 

In the explicit embodiment according to the present 
invention shown in the annexed drawing and described 
above, a combination of the camera and the light source 

10 is arranged in each case on the robot arm. The invention 
is however not limited hereto. The camera can for 
instance be disposed fixedly, for instance on a fence 
part of a milking parlour, wherein the laser or the 
light source is then mounted on the robot arm. The robot 

15 arm can herein realize at least a part of the pattern to 
be followed, for which purpose a separate, moveable 
component would otherwise be necessary. It is also 
possible that not the light source but the camera be 
placed on the robot arm, and both the light source and 

20 the camera can also be arranged separately or together 
at a position other than on the robot arm. The light 
source and the camera can herein be stationary relative 
to each other, although it is also possible for the 
light source and the camera to be disposed separately 

25 and displaceable relative to each other in any other 
conceivable manner. 
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CLAIMS 

1. Method for determining the position of at least 
one teat of an udder of an animal for milking, 
comprising of: 

- illuminating points on the udder with at least one 
5 directed light source in a predetermined pattern; 

- detecting points illuminated with the light source in 
the pattern with recording means; 

- determining position data of illuminated points from a 
detection of the recording means on the basis of 

10 triangulation; 

- forming a three-dimensional representation of the 
udder from the position data and the pattern; 

- recognizing the teat in the three-dimensional 
representation; and 

15 - determining the location of the teat on the basis of 
the recognition and with the position data. 

2. Method as claimed in claim 1, further comprising 
of driving the light source pulsatingly and detecting 
illuminated points when the light source is in 

20 operation. 

3. Method as claimed in claim 1 or 2, further 
comprising of making at least two detections with the 
light source in and out of operation, and calculating 
the difference between the detections with the light 

25 source in and out of operation. 

4. Method as claimed in any of the foregoing 
claims, further comprising of connecting a teat cup to 
the teat with a robot arm at the determined location of 
the teat. 
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5 . Method as claimed in any of the foregoing 
claims, comprising of disposing the light source and the 
recording means stationary relative to each other. 

6. Method as claimed in claims 4 and 5, further 
5 comprising of arranging the light source and the 

recording means on the robot arm. 

7. Method as claimed in any of the claims 1-4, 
further comprising of disposing the light source and the 
recording means separately and displaceably relative to 

10 each other. 

8. Method as claimed in claims 4 and 7, further 
comprising of arranging one of the light source and the 
recording means on the robot arm. 

9. Method as claimed in any of the foregoing 
15 claims, comprising of displacing at least the light 

source in a direction corresponding with the pattern. 

10. Method as claimed in any of the foregoing 
claims, comprising of varying the orientation of the 
light source in a direction corresponding with the 

* 

20 pattern. 

11. Method as claimed in claims 9 and 10, wherein 
the pattern to be followed is zigzag-shaped, and 
comprising of displacing the light source in a first 
direction and varying the orientation of the light 

25 source in a second direction lying substantially 
transversely of the first direction. 

12. Method as claimed in claim 11, wherein the 
second direction corresponds with the longitudinal 
direction of the animal for milking. 

30 13. Method as claimed in claims 1 and 4, further 

comprising of: defining a distinction between a part of 
the udder located close to the robot arm and a part of 
the udder located further from the robot arm, wherein 
the udder has at least two teats, at least one of which 

35 belongs to each of the parts; distinguishing the teats 
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of the udder in accordance herewith; connecting teat 
cups one by one to the teats on the part of the udder 
situated further from the robot arm; and subsequently 
connecting teat cups one by one to the teats on the part 
5 of the udder situated close to the robot arm. 

.14. Method for determining the position of at least 
one teat of an udder of an animal for milking, 
comprising of: 

- illuminating points on the udder pulsatingly with at 
10 least one directed light source in a predetermined 

pattern; 

- detecting with recording means points illuminated with 
light pulses from the light source in the pattern; 

- determining position data of illuminated points from a 
15 detection of the recording means; 

- forming a representation of the udder from the 
position data and the pattern; 

- recognizing the teat in the representation; and 

- determining the location of the teat on the basis of 
20 the recognition and with the position data. 

15. Method for determining the position of at least 
one teat of an udder of an animal for milking, 
comprising of: 

- illuminating the udder with at least one directed 

25 light source, for instance in a predetermined pattern of 
points; 

- making at least two detections of the udder with 
recording means with the light source in and out of 
operation; 

30 - determining a representation of the udder from the 
difference between the detections with the recording 
means; 

- recognizing the teat in the representation; and 

- determining the location of the teat on the basis of 
35 the recognition. 
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16. Device for determining the position of at least 
one teat of an udder of an animal for milking as claimed 
in at least one of the foregoing claims , comprising: 

- a directed light source for illuminating points 
5 on the udder in a predetermined pattern to be followed; 

- recording means for detecting points illuminated 
with the light source when the pattern is followed; and 

- at least one computer unit which is adapted for: 
determining position data of illuminated points from a 

10 detection of the recording means on the basis of 
triangulation; forming a three-dimensional 
representation of the udder from the position data, and 
the pattern; recognizing the teat in the three- 
dimensional representation; and determining the location 

15 of the teat on the basis of the recognition and with the 
position data. 

17. Device as claimed in claim 16, further 
comprising a robot arm for arranging teat cups on the 
teat and a control of the robot arm for connecting a 

20 teat cup to the teat at the location of the teat 
determined by the computer unit. 

18. Device as claimed in claim 17 , wherein the 
light source and the recording means are arranged on the 
robot arm and the control is adapted to actuate the 

25 robot arm in a movement corresponding to the pattern. 

19. Device for determining the position of at least 
one teat of an udder of an animal for milking as claimed 
in at least one of the foregoing claims , comprising: 

- a directed light source for pulsatingly 

30 illuminating points on the udder in a predetermined 
pattern to be followed; 

- recording means for detecting points illuminated 
with the light source when the pattern is followed; 

- at least one computer unit which is adapted for: 
35 determining position data of illuminated points from a 
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detection of the recording means; forming a 
representation of the udder from the position data and 
the pattern; recognizing the teat in the representation; 
and determining the location of the teat on the basis of 
5 the recognition and with the position data. 

20. Device for determining the position of at least 
one teat of an udder of an animal for milking as claimed 
in at least one of the foregoing claims , comprising: 

- a directed light source for illuminating the 
10 udder; 

- recording means for making at least two 
detections of the udder with the light source in and out 
of operation; and 

- at least one computer unit which is adapted for: 
15 forming a representation of the udder from a difference 

between the detections of the recording means; 
recognizing the teat in the representation; and 
determining the location of the teat on the basis of the 
recognition. 
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